Identifying personalized meaningful locations

ABSTRACT

A system and method for identifying and labeling locations frequented by a user of a mobile communication device track geographic positions and environmental or contextual factors as the user moves about, and identify locations of interest to the user via a clustering procedure. As the device collects contextual data, the system and method label each identified location to create a location model. This model allows the device to label new locations as they arise. The model may be periodically updated by separately processing geographic position data gathered after the model was created to determine if the cluster locations and labels remain accurate.

TECHNICAL FIELD

The present disclosure is related generally to location identification,and, more particularly, to a system and method for identifying andclassifying locations frequented by a user of a mobile communicationdevice.

BACKGROUND

Mobile communication devices can often access both map information andlocation databases, allowing such devices to guide users to knownlocations of interest. For example, a user travelling in downtownChicago may be notified of his proximity to Navy Pier or the WillisTower, while a user travelling in Agra, Uttar Pradesh, India may benotified that the Taj Mahal is close to his present location. Knownlocations of interest may include theaters, stadiums, stores, hospitals,museums and so on.

Such systems, however, do not provide assistance or value to a userwhile the user passes among locations that are not known locations ofinterest, but rather are locations that are of interest only to alimited number of individuals, perhaps only to the user. The user mayprogram locations and associated labels into a mobile communicationdevice, but this task is one that most users do not undertake, evenamong those who know how.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

While the appended claims set forth the features of the presenttechniques with particularity, these techniques, together with theirobjects and advantages, may be best understood from the followingdetailed description taken in conjunction with the accompanying drawingsof which:

FIG. 1 is a generalized schematic of an example device with respect towhich the presently disclosed innovations may be implemented;

FIG. 2 is a location schematic showing an example device and userenvironment within which an example of the disclosed principles may beimplemented;

FIG. 3 is a flow chart showing the collection and clustering ofgeographic position data in accordance with embodiments of the disclosedprinciples;

FIG. 4 is a flow chart showing the labeling of identified clusters inaccordance with embodiments of the disclosed principles; and

FIG. 5 is a flow chart showing the processing and labeling of newgeographic position data according to a location model in accordancewith embodiments of the disclosed principles.

DETAILED DESCRIPTION

The present disclosure is directed to a system that may eliminate someof the shortcomings noted in the Background section. It should beappreciated, however, that any such benefit is not necessarily alimitation on the scope of the disclosed principles or of the attachedclaims, except to the extent expressly noted in the claims. Beforepresenting a detailed discussion of embodiments of the disclosedprinciples, an overview of certain embodiments is given to aid thereader in approaching the later discussion. As noted above, mobilecommunication devices are capable of providing guidance to a userregarding known locations of interest. With respect to locations thatare of interest only to the user, however, e.g., because they form partof the user's daily routine, such capabilities are of no assistance.

In an embodiment of the disclosed principles, a mobile device isassociated with a user and is generally kept with the user as the usergoes about his or her daily tasks. The device tracks geographicpositions and environmental or contextual factors as the user movesabout, and identifies locations of interest to the user via a clusteringprocedure. Similarly, as the device collects contextual data, it is ableto label each identified location as well. In this way, in a furtherembodiment, the device is able to preemptively modify its behavior suchas by modifying its authentication mode, ringer mode, screen mode,networking status and so on as the user enters various locations.

The device may also alert the user to any relevant factors associatedwith any location. For example, as the user reaches a parking garageafter being in his office, the device may generate a traffic reportrelated to the user's general homeward driving route.

Turning now to a more detailed discussion in conjunction with theattached figures, techniques of the present disclosure are illustratedas being implemented in a suitable environment. The followingdescription is based on embodiments of the disclosed principles andshould not be taken as limiting the claims with regard to alternativeembodiments that are not explicitly described herein. Thus, for example,while FIG. 1 illustrates an example mobile device within whichembodiments of the disclosed principles may be implemented, it will beappreciated that many other devices such as but not limited to laptopcomputers, tablet computers, personal computers, embedded automobilecomputing systems and so on may also be used.

The schematic diagram of FIG. 1 shows an exemplary device 110 formingpart of an environment within which aspects of the present disclosuremay be implemented. In particular, the schematic diagram illustrates auser device 110 including several exemplary components. It will beappreciated that additional or alternative components may be used in agiven implementation depending upon user preference, cost, and otherconsiderations.

In the illustrated embodiment, the components of the user device 110include a display screen 120, applications 130, a processor 140, amemory 150, one or more input components 160 such as speech and textinput facilities, and one or more output components 170 such as text andaudible output facilities, e.g., one or more speakers.

The one or more input components 160 of the device 100 also include atleast one sensor or system that measures or monitors environmentalinformation associated with a current geographic position of the device100. The data collected at a geographic position may be referred toherein as a data point. The environmental information may include, forexample, ambient light level, ambient noise level, voice detection ordifferentiation, movement detection and differentiation, and so on.Similarly, the device 100 may also include a sensor configured fordetermining a geographic position of the device such as a GPS module andassociated circuitry and software.

The processor 140 can be any of a microprocessor, microcomputer,application-specific integrated circuit, or the like. For example, theprocessor 140 can be implemented by one or more microprocessors orcontrollers from any desired family or manufacturer. Similarly, thememory 150 may reside on the same integrated circuit as the processor140. Additionally or alternatively, the memory 150 may be accessed via anetwork, e.g., via cloud-based storage. The memory 150 may include arandom access memory (i.e., Synchronous Dynamic Random Access Memory(SDRAM), Dynamic Random Access Memory (DRAM), RAMBUS Dynamic RandomAccess Memory (RDRM) or any other type of random access memory device).Additionally or alternatively, the memory 150 may include a read onlymemory (i.e., a hard drive, flash memory or any other desired type ofmemory device).

The information that is stored by the memory 150 can include programcode associated with one or more operating systems or applications aswell as informational data, e.g., program parameters, process data, etc.The operating system and applications are typically implemented viaexecutable instructions stored in a non-transitory computer readablemedium (e.g., memory 150) to control basic functions of the electronicdevice 110. Such functions may include, for example, interaction amongvarious internal components and storage and retrieval of applicationsand data to and from the memory 150.

The illustrated device 110 also includes a network interface module 180to provide wireless communications to and from the device 110. Thenetwork interface module 180 may include multiple communicationinterfaces, e.g., for cellular, WiFi, broadband and othercommunications. A power supply 190, such as a battery, is included forproviding power to the device 110 and its components. In an embodiment,all or some of the internal components communicate with one another byway of one or more shared or dedicated internal communication links 195,such as an internal bus.

Further with respect to the applications, these typically utilize theoperating system to provide more specific functionality, such as filesystem service and handling of protected and unprotected data stored inthe memory 150. Although many applications may govern standard orrequired functionality of the user device 110, in many casesapplications govern optional or specialized functionality, which can beprovided, in some cases, by third party vendors unrelated to the devicemanufacturer.

Finally, with respect to informational data, e.g., program parametersand process data, this non-executable information can be referenced,manipulated, or written by the operating system or an application. Suchinformational data can include, for example, data that are preprogrammedinto the device during manufacture, data that are created by the device,or any of a variety of types of information that is uploaded to,downloaded from, or otherwise accessed at servers or other devices withwhich the device is in communication during its ongoing operation.

In an embodiment, the device 110 is programmed such that the processor140 and memory 150 interact with the other components of the device 110to perform a variety of functions. The processor 140 may include orimplement various modules and execute programs for initiating differentactivities such as launching an application, transferring data, andtoggling through various graphical user interface objects (e.g.,toggling through various icons that are linked to executableapplications).

As noted above in overview, a mobile communication device operating inaccordance with an embodiment of the disclosed principles gathersambient environmental data and user behavior data as the device movesabout with the device user. The gathered data is used to generateclusters based on data features, wherein each cluster has a radiusassociated with a predetermined confidence level. As more dataaccumulates, the cluster position and radius may be altered and theconfidence level may increase. When sufficient data has been accumulatedfor a given cluster, the device labels the cluster with its discernedpurpose, e.g., home, office, gym, etc. The user need not flag locationsor manually label any location.

A simplified example device usage environment 200 is shown schematicallyin FIG. 2. As can be seen in the illustrated example, the environmentfor the user device 201 includes the user's home 202, the user'sworkplace 203, and the user's gym 204. Each location 202, 203, 204 andsome intervening geographic positions also have respective networksassociated with them.

Thus, a first WiFi network 205 is associated with the user's home 202, asecond WiFi network 206 is associated with the user's workplace 203, anda third WiFi network 207 is associated with the user's gym 204. In theillustrated example, a cellular network 208 is associated with a portionof the user's travel path 209 between the user's home 202 and the user'sgym 204. The illustrated environment 200 also includes a number of othergeographic positions 210, 211, 212, 213 that the user visits onlyinfrequently if at all.

Each dot signifies a data position 214, which is a geographic positionwhere the device 201 gathered data at some point in time. As can beseen, the data positions tend to group near the locations that the userfrequents simply because the user is more often at these locations. Thedata collected at the data positions 214 may vary depending upon dataavailable at each position. The device attempts to collect environmentaland user behavior data that may yield differentiating features. Thus,for example, the device may attempt to collect at each position thedevice coordinates (latitude/longitude), detected connectivity options(available WiFi networks, Bluetooth connections), device speed, timeinformation (e.g., time of day, day of week, etc.), location variance,ambient light level, ambient sound level and so on.

After a sufficient period of collecting data, e.g., a week or two weeks,the device extracts features from the data to correlate and discriminatebetween positions. With the extracted features for each data positionknown, a clustering approach is applied to the set of data positions togenerate location clusters based on features. The clustering approachmay be any suitable approach, but in an embodiment, a K-means clusteringapproach, which is known to those of ordinary skill in the art, isapplied.

After a number of location clusters have been obtained from theclustering process, labeling criteria are applied to each cluster toautomatically label the clusters. Different criteria may be used toidentify different clusters. For example, the potential criteria thatcan be used to identify the user's Home and Work locations may be: thenumber of points in each cluster, the average proximity between acluster point to the cluster centroid, the percentage of data pointsthat were collected at night, the percentage of data points that werecollected on a weekend, and the percentage of data points for which thephone was in sleep mode.

With respect to cluster labeling, a weight may also be assigned to eachcriterion. In an embodiment, a score is first calculated from eachcriterion for each cluster, at which point the overall score of eachcluster is obtained by a weighted linear combination of all scores. Thenthe cluster with the highest score may be labeled as Home, and thecluster with the second highest score may be labeled as Work.

Once the clusters are labeled, the radius of each cluster is calculatedin an embodiment so that the radius can be used for further detection ofunknown locations. To generate the radius for a given cluster, thedistances between cluster points and the cluster centroid arecalculated, and the n^(th) percentile is selected to represent theradius of the cluster, where n indicates what portion of the data pointsare believed to actually belong to the cluster.

The device further generates adaptive confidence levels associated withthe location model. These confidence levels may be calculated based onvarious factors, such as how much data has been collected when thelocation identification, labeling and radiusing decisions are made, howvariant the data points are in one cluster, and so on. These confidencelevels improve decision making when the model is operating. For example,if the learned radius of the Home cluster is 100 meters, but theconfidence level is only 20%, which is lower than a pre-specifiedthreshold of for example 60%, then the device may decide not to trustthe learned radius and may instead use a default radius for Home. Thismakes the location model more reliable to use.

After the location model is built, it can be used to label any newlocation data. Thus, given a new data point (associated with a newgeographic position), the distance between the new geographic positionand the learned location clusters is first calculated; if this distanceis smaller than the radius of a known location, then the device assignsthe label of this geographic position to the new location. If the newlocation falls into multiple clusters, then the device assigns the labelassociated with the smallest distance to the geographic position. If thenew geographic position does not fall within the radius of any cluster,then the device may not assign a label to the geographic position.

With the foregoing in mind, FIG. 3 illustrates a flowchart of thedescribed process 300 for first identifying data point clusters. Theflowchart will assume for clarity that the process 300 is executed onthe mobile device itself, however, it will be appreciated that theprocess may be executed partially or wholly on another device such as aserver remote from the mobile device.

At stage 301 of the process 300, the device determines that a sufficientperiod of data collection has been undertaken and that consequently asufficient number of data points have been sampled. The period ofcollecting data may be, for example, a week or two weeks. At stages302-303 of the process 300, the device extracts features from the datato correlate and discriminate between geographic positions.

In particular, at stage 302, the device evaluates all geographicposition sample sets to identify and extract features that exhibit anon-even or non-continuously varying distribution. At stage 303, thedevice optionally extracts additional features that bear a correlationto the identified features for at least a substantial subset ofgeographic positions, e.g., greater than 25% of locations. For example,if the extracted features include an available network at eachgeographic position, this feature is a distinguishing or clusteringfeature across all geographic positions for purposes of stage 302. Ifanother feature correlates to the available network at a givengeographic position but not to any other geographic position, this maybe a correlated feature for purposes of stage 303.

With the extracted features for each data point known, a clusteringapproach is applied at stage 304 to the set of extracted features togenerate geographic position clusters corresponding to user locations ofinterest. As noted above, a K-means clustering approach or othersuitable clustering process may be used at this stage.

Having identified a number of user locations of interest (clusters)through execution of the process 300, the device then labels eachidentified location of interest. An example labeling process 400 isshown in the flowchart of FIG. 4. In a first stage 401, which may beexecuted during or substantially prior to the process 400, a number oflabeling criteria are selected.

In an embodiment, the criteria, when applied as a set, serve todifferentiate between different data points so as to allow labeling ofall clusters. However, more typically, different sets of criteria willbe associated with different potential user locations of interest. Forexample, a first set of criteria may be applied to all clusters, and thecluster that scores the highest may be labelled Home, while a seconddifferent set of criteria may be applied to identify the user's Worklocation. The process 400 exemplifies the latter, although it will beappreciated that either type of criteria set may be used.

Thus at stage 402 or the process 400, the device applies a first subsetof the selected criteria associated with a first label to the identifiedclusters, and, at stage 403, identifies the cluster generating thehighest score based on the first subset of the selected criteria. Atstage 404, the device labels the highest scoring cluster with the firstlabel.

At stage 405, the device checks whether there are other criteria subsetsstill to be applied. If not, the process 400 ends, whereas otherwise,the process 400 flows to stage 406 to increment the criteria set numberand returns to stage 402 to apply the next set of criteria and apply theassociated label.

Different criteria may be used to identify different clusters. Forexample, the potential criteria that can be used to identify the user'sHome and Work locations may be: the number of points in each cluster,the average proximity between a cluster point to the cluster centroid,the percentage of points that were collected at night, the percentage ofpoints that were collected on a weekend, and the percentage of pointsfor which the phone was in sleep mode.

With respect to cluster labeling, a weight may also be assigned to eachcriterion. In an embodiment, a score is first calculated from eachcriterion for each cluster, at which point the overall score of eachcluster is obtained by a weighted linear combination of all scores. Thenthe cluster with the highest score may be labeled as Home, and thecluster with the second highest score may be labeled as Work.

To complete the location model in an embodiment of the disclosedprinciples, a radius is assigned to each labelled cluster as notedabove, to allow classification of future data locations. In a furtherembodiment, for a cluster having n geographic positions appearing tobelong to the cluster, the n^(th) percentile of the distances betweenthe geographic positions of the cluster and the cluster centroid areused to set the radius of the cluster. It will be appreciated that othermethods may be used instead to set each cluster radius.

Once the location model is built, e.g., as set forth above, the locationmodel may be used to differentiate and label, where appropriate, any newgeographic position data. An example process 500 for treating newgeographic position data is shown in the flowchart of FIG. 5. Newgeographic position data is received at stage 501 of the process 500,e.g., when the device periodically makes a data collection according toa schedule or upon sensing a substantial move or new environmentalcondition.

At stage 502, the distance between the new geographic position and thecentroid of each labelled location cluster of the model is calculated.The new geographic position will be either within the radius of one ormore location clusters or will be outside of the radii of all locationclusters. At stage 503, the device compares the calculated distanceagainst the various cluster radii to determine whether the newgeographic position exists within one cluster, multiple clusters, or nocluster.

If it is determined at stage 503 that the new geographic position lieswithin a single cluster, then the process 500 flows to stage 504,wherein the device labels the new geographic position with the label ofthat single cluster. If it is determined at stage 503 that the newgeographic position lies within multiple clusters, then the process 500flows to stage 505, wherein the device labels the new geographicposition with the label of the cluster to whose centroid the newgeographic position lies closest. Finally, if it is determined at stage503 that the new geographic position does not fall within the radius ofany cluster, then the process 500 flows to stage 506, wherein deviceleaves the new geographic position unlabeled.

As with existing locations, a confidence level can also be obtained forthe labeling of a new geographic position. For example, assume ageographic position is predicted as Home with 70% confidence, Work with20% confidence, and other places with 10% confidence. The confidence canbe estimated from how far the new geographic position is to the knownlocations. It is possible that some of the significant locations for theuser will change from time to time. For example, the user may move to adifferent home or work location.

For this reason, the device periodically updates identified locations ofinterest to the user. In each update, the location detection approach isperformed first for newly collected geographic position data. Then eachidentified location is compared to the location that is already storedin the system. If the difference between two locations is very small,i.e., within a threshold, that means that this location has not beenchanged, and the new data point is used to update the old location tomake it more accurate; if two locations differ significantly, i.e., byan amount exceeding a threshold, then the old location will be discardedand the new location will be stored in the system for further use. Thisnot only makes the location detection more accurate based on new datapoints, but also ensures that the system does not miss a significantlocation change.

It will be appreciated from the foregoing that a system and method forthe identification and labeling of user locations of interest has beendisclosed. However, in view of the many possible embodiments to whichthe principles of the present disclosure may be applied, it should berecognized that the embodiments described herein with respect to thedrawing figures are meant to be illustrative only and should not betaken as limiting the scope of the claims. Therefore, the techniques asdescribed herein contemplate all such embodiments as may come within thescope of the following claims and equivalents thereof.

We claim:
 1. A method of identifying locations of interest to a user viaa mobile communication device associated with the user, the methodcomprising: collecting data at the mobile communication device for eachof a plurality of geographic positions to generate a location data set,the data for each of the plurality of geographic positions including oneor more features associated with at least one of environmental data anduser behavior data collected at the geographic position; extracting fromthe location data set at least one feature that distinguishes the dataassociated with a first subset of the geographic positions from the dataassociated with a second distinct subset of the geographic positions;clustering the location data set to generate a plurality of distinctclusters of data and associated geographic positions therefrom based onthe extracted at least one feature; and assigning a label to each of theplurality of distinct clusters.
 2. The method in accordance with claim 1wherein clustering the location data set to generate a plurality ofdistinct clusters includes defining a radius of each cluster.
 3. Themethod in accordance with claim 2 wherein the one or more featuresinclude one or more of coordinates of the device, wireless connectivityoptions detected by the device, device speed, current time data, deviceposition variance, ambient light level at the device and ambient soundlevel at the device.
 4. The method in accordance with claim 3 whereinthe wireless connectivity options detected by the device include atleast one of a WiFi network, a Bluetooth link and a cellular link. 5.The method in accordance with claim 3 wherein the current time includesat least one of the time of day, day of the week and date.
 6. The methodin accordance with claim 2 further comprising collecting data at a newgeographic position and applying a label of an existing cluster to thenew geographic position by determining that the new geographic positionis within the radius of a cluster and applying the label of that clusterto the new geographic position.
 7. The method in accordance with claim 1further detecting that the device is within a labeled location andexecuting an action including one of modifying a device authenticationmode, modifying a device ringer mode, modifying a device screen mode,modifying a device networking status, alerting the user and providinginformation to the user associated with the location.
 8. The method inaccordance with claim 6 further including defining a confidence level tothe labeling of the new geographic position.
 9. The method in accordancewith claim 1 wherein clustering the location data set to generate aplurality of distinct clusters comprises applying a K-means clusteringmethodology based on the extracted features of the location data set.10. A mobile communication device configured to be used by a user and toidentify locations of interest to the user, the mobile communicationdevice comprising: a set of sensing elements configured to sense dataincluding one or more environmental conditions and user behaviors at thedevice geographic position; and a processor configured to use the set ofsensing elements to collect the data for each of a plurality ofgeographic positions, generating a location data set, the data for eachof the plurality of locations including one or more features associatedwith at least one of environmental condition data and user behavior datacollected at the geographic position, and to extract at least onefeature from the location data set to distinguish the data associatedwith a first subset of the geographic positions from the location dataassociated with a second distinct subset of the geographic positions,and to cluster the location data set, generating a plurality of distinctclusters of data and associated geographic positions, and to assign alabel to each of the plurality of distinct clusters.
 11. The mobilecommunication device in accordance with claim 10 wherein clustering thelocation data set to generate a plurality of distinct clusters includesdefining a radius of each cluster.
 12. The mobile communication devicein accordance with claim 11 wherein the one or more features include oneor more of coordinates of the device, wireless connectivity optionsdetected by the device, device speed, current time data, device positionvariance, ambient light level at the device and ambient sound level atthe device.
 13. The mobile communication device in accordance with claim12 wherein the wireless connectivity options detected by the deviceinclude at least one of a WiFi network, a Bluetooth link and a cellularlink.
 14. The mobile communication device in accordance with claim 10wherein the processor is further configured to detect that the device iswithin a labeled location and execute an action including one ofmodifying a device authentication mode, modifying a device ringer mode,modifying a device screen mode, modifying a device networking status,alerting the user and providing information to the user associated withthe location.
 15. The mobile communication device in accordance withclaim 11 wherein the processor is further configured to collect data ata new geographic position and to apply a label of an existing cluster tothe new geographic position.
 16. The mobile communication device inaccordance with claim 15 wherein the processor is configured to apply alabel of an existing cluster to the new geographic position bydetermining that the new geographic position is within the radius of acluster and applying the label of that cluster to the new geographicposition.
 17. The mobile communication device in accordance with claim15 wherein the processor is further configured to assign a confidencelevel to the labeling of the new geographic position.
 18. The mobilecommunication device in accordance with claim 10 wherein the processoris configured to cluster the location data set by applying a K-meansclustering methodology based on the extracted features of the locationdata set.
 19. A method of identifying personalized meaningful locationsfor a user comprising: collecting data via a user mobile communicationdevice from each of a plurality of geographic positions visited by theuser to form a location data set, the data for each geographic positionincluding data linked to the geographic position as well as data relatedto user behavior at the geographic position; identifying a plurality ofdata features across the location data set, each geographic positionexhibiting a value for each of the plurality of data features;clustering the geographic positions represented in the location data setto separate the visited geographic positions into a plurality ofdistinct clusters; and labeling each cluster.
 20. The method inaccordance with claim 19, wherein clustering the geographic positionsrepresented in the location data set comprises applying a K-meansclustering methodology to the location data set with respect to theplurality of data features.